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ABSTRACT 


Research  in  support  of  the  Army’s  recruiting  operations  was  conducted  to  (a)  develop 
a  valid  criterion  of  recruiter  effectiveness,  and  (b)  develop  and  evaluate  a  recruiter  selection 
test  battery.  Using  data  from  a  sample  of  400  recruiters,  statistical  analyses  were  performed 
to  determine  the  theoretical  yield  to  be  expected  from  each  recruiter’s  territory  based  on  a 
multiple  correlation  between  territorial  characteristics  and  production  records.  A  formula 
was  developed  to  express  each  recruiter’s  effectiveness,  comparing  his  actual  production 
with  the  predicted  production.  In  Task  B,  tests  were  assembled  to  measure  recruiter 
characteristics  considered  likely  to  be  associated  with  recruiting  effectiveness:  verbal 
fluency,  sociability,  achievement  motivation,  empathy,  maturity  /responsibility,  and  various 
background  characteristics.  The  tests  were  administered  to  45  highly  successful,  and  to  43 
very  unsuccessful,  recruiters.  None  of  the  individual  test  scores  discriminated  significantly 
between  good  and  poor  recruiters.  One  performance  measure  of  verbal  fluency  did 
discriminate  significantly,  as  did  about  20  background-information  items.  The  true  value  of 
these  items  for  recruiter  selection  cannot  be  known  until  cross-validation  has 
been  accomplished. 
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SUMMARY  AND  CONCLUSIONS 


PROBLEM 

With  the  termination  of  the  draft,  the  Army’s  need  to  maximize  the  effectiveness  of  its 
recruiting  operation  is  clear.  The  research  described  in  this  report  was  part  of  a  program 
aimed  at  developing  a  procedure  for  identifying  men  most  likely  to  be  effective  recruiters. 


OBJECTIVES 

Specific  objectives  of  the  research  were:  (a)  to  develop  a  valid  criterion  of  recruiter 
effectiveness,  and  (b)  to  develop  a  selection  test  (or  test  battery)  for  identifying  men  most 
likely  to  succeed  as  recruiters. 


APPROACH 

To  develop  a  valid  criterion  of  recruiter  effectiveness,  a  random  sample  of  400 
recruiters  was  selected.  Information  was  collected  on  each  recruiter’s  total  production 
(number  of  accessions)  over  a  six-month  period,  and  on  various  characteristics  of  his 
territory  that  might  influence  its  fertility.  (By  “fertility,”  we  mean  the  relative  ease  or 
difficulty  of  obtaining  enlistments  in  a  particular  territory.)  Using  multiple  regression 
techniques,  an  equation  was  developed  to  predict  the  yield  from  each  territory.  Benchmark 
Achievement  Scores  (BAS)  were  then  computed  to  express  each  man’s  actual  production  in 
relation  to  the  theoretical  potential  of  his  territory. 

To  develop  an  improved  selection  procedure,  a  number  of  tests— some  already  existing 
and  some  developed  in  this  research— were  assembled  to  measure  various  characteristics  that 
might  be  related  to  recruiter  effectiveness:  verbal  fluency,  sociability,  achievement 
motivation,  empathy,  rejection  tolerance,  maturity -responsibility,  and  various  background 
characteristics.  Using  a  composite  supervisor  rating  procedure,  45  of  the  best  recruiters  in 
the  Army,  and  43  of  the  poorest,  were  identified  and  administered  the  draft  selection  test 
instruments.  Results  were  analyzed  to  identify  items  or  scores  that  differentiated  between 
good  and  poor  recruiters. 


RESULTS 

The  criterion  development  study  showed  that  a  single  predictor— Average  Production 
per  Recruiter  in  Subject’s  District  Recruiting  Command  (DRC)— accounted  for  48%  of  the 
variance  in  production  scores.  Average  market  share  (i.e.,  popularity  of  the  Army  compared 
with  the  other  Services)  accounted  for  an  additional  2%  of  the  variance.  A  Simple 
Achievement  Score  (SAS),  which  expresses  each  man’s  production  as  a  percentage  of  the 
average  for  his  DRC,  correlated  +.96  with  BAS  scores,  and  was  judged  to  be  the  preferred 
measure  since  it  is  more  easily  computed. 

In  the  recruiter  selection  study,  none  of  the  personality  measures  differentiated 
between  the  good  and  poor  recruiters.  One  performance  measure  of  verbal  fluency,  the 
“Ah”  ratio,  discriminated  significantly,  as  did  about  20  background  information-type  items. 
These  variables  have  not  been  cross-validated,  however. 
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CONCLUSIONS 

(1)  Production  scores  of  recruiters  are  strongly  influenced  by  the  DRC  to  which  they 
are  assigned;  in  other  words,  about  50%  of  the  variance  in  production  scores  derives  from 
factors  unrelated  to  the  individual  recruiter's  characteristics. 

(2)  Simple  Achievement  Scores  (SAS)  appear  to  be  a  more  equitable  measure  of  a 
recruiter’s  effectiveness  than  other  more  traditional  measures. 

(3)  Twenty  background  items  that  may  be  of  value  in  selecting  recruiter*  here  been 
identified,  but  their  true  value  cannot  be  assessed  without  cross-validation. 
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PREFACE 


This  report  d— crib—  research  directed  at  developing  an  improved  procedure  tor 
•electing  recruiter*  that  will  enhance  the  overall  effectiveneaa  of  Army  recruiting.  The 
reeeatch  waa  conducted  by  the  Human  Reaourcea  Research  Organiiation,  under  contract 
with  the  U.S.  Army  Research  Institute  for  the  Behavioral  and  Social  Sciences,  as  part  of 
Work  Unit  RECRUIT,  Sub-Unit  1,  Research  on  Recruiting. 

The  work  was  performed  by  HumRRO  Division  No.  7  (Social  Sciences)  in  Alexandria, 
Virginia.  Dr.  Robert  G.  Smith  waa  the  Director  of  thia  Division,  which  ia  now  a  part  of 
HumRRO'i  Eastern  Division,  with  Dr.  J.  Daniel  Lyons  as  Director.  Dr.  George  ii.  Brown 
waa  the  Work  Unit  Leader.  Mr.  John  D.  Harris  played  a  major  role  in  developing  the  draft 
selection  test  instruments.  SP5  Mark  D.  Wood,  who  was  assigned  by  AR1  to  work  full  time 
on  this  project,  performed  most  of  the  test  administration  and  assisted  in  all  other  phases  of 
the  work.  The  report  was  written  by  Dr.  Brown  and  Specialist  Wood. 

Work  Unit  RECRUIT  waa  performed  for  the  U.S.  Army  Recruiting  Command. 
Appreciation  is  expressed  to  USAREC  personnel  tor  their  cooperation,  and  especially  to  the 
individual  recruiters  who  served  as  research  subjects. 

HumRRO  research  for  the  Department  of  the  Army  in  Work  Unit  RECRUIT  waa 
conducted  under  Contract  DAHC19-73-C-0Q04.  Army  Training  Research  ia  conducted 
under  Army  Project  2Q062107A745. 


Meredith  P.  Crawford 
President 

Human  Resources  Research  Organisation 
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Chapter  1 

INTRODUCTION 


BACKGROUND 

With  the  end  of  the  military  draft  in  January  1973,  the  Army’s  need  to  maximize  the 
effectiveness  of  its  overall  recruiting  operations  was  greatly  intensified.  In  June  1972,  in 
anticipation  of  this  need,  HumRRO  was  asked  to  undertake  a  research  program  that  would 
ultimately  provide  an  effective  procedure  for  selecting  Army  recruiters.  The  assumption  was 
that  good  recruiters  differ  from  poor  recruiters  ir  wme  identifiable  personal  characteristics; 
if  these  could  be  identified  and  measured,  it  should  be  possible  to  devise  „  procedure  for 
selecting,  as  recruiters,  only  those  individuals  most  likely  to  be  successful  at  this  job. 

Ill  the  first  phase  of  this  project,  a  pilot  study  (Work  Unit  RECRUIT  I)  was  conducted 
to  provide  hypotheses  concerning  the  personal  characteristics  and  job  behaviors  associated 
with  recruiter  success.  Structured  interviews  were  conducted  with  a  sample  of  79  recruiters 
with  high,  average,  and  low  records  of  success  in  terms  of  percentage  of  objective  (quota) 
achieved.  Analysis  of  the  pilot  study  data  provided  a  picture  of  the  nature  of  recruiting  duty 
and  formed  a  basis  for  inferring  some  of  the  requisite  personal  characteristics. 


REVIEW  OF  THE  LITERATURE  ON  RECRUITER  SELECTION 

The  research  literature  on  recruiter  selection  is  quite  small;  much  more  material  is 
available  in  the  related  field  of  salesman  selection.  The  RECRUIT  I  pilot  study  report 
mentioned  earlier  contains  a  short  review  of  virtually  all  recruiter  selection  studies  published 
up  to  that  time.  That  review  indicates  that  no  previous  effort  to  develop  a  recruiter  selection 
instrument  had  been  more  than  marginally  successful. 

Among  relatively  recent  studies  in  this  area,  three  are  of  interest.  Bennett  and  Haber1 
surveyed  a  group  of  259  Marine  recruiters  at  29  different  recruiting  stations  to  explore  the 
influences  on  productivity  cf  three  classes  of  variables:  (a)  characteristics  of  the  individual, 
such  as  aptitude  test  scores  and  age;  (b)  geographical  characteristics,  that  is,  area  of  U.S. 
(e.g..  Northeast,  Southeast),  and  (c)  deployment  variables,  such  as  proximity  of  the 
recruiter’s  working  station  to  his  home  state.  The  average  number  of  recruits  enlisted  per 
month  was  used  as  the  criterion  of  productivity. 

Bennett  and  Haber  found  that  most  of  their  predictor  variables  had  a  negligible 
relationship  to  recruiter  performance  and  that  "the  most  important  determinant  of 
performance  is  the  propensity  to  enlist  in  the  recruiting  market  to  which  the  recruiter  is 
assigned.  In  areas  with  low  enlistment  rates,  however,  recruiters  who  have  served  tours  as 
career  planners  are  -.ore  productive  than  others.  Moreover,  recruiters  who  work  in  areas 
near  their  home  are  likely  to  have  an  advantage  as  is  a  recruiter  who  works  in  an 
urban  /suburban  environment  instead  of  in  a  rural  area.” 


*J.T.  Bennett  and  S.E.  Haber.  Selection.  Deployment,  and  Evaluation  of  Marine  Recruiters,  The 
George  Washington  University  School  of  Engineering  end  Applied  Science,  Institute  of  Management  Science 
and  Engineering.  Project  NR  347020.  Office  of  Naval  Research,  1973. 


Ai  will  br  seen,  Bennett  and  Haber's  emphasis  on  the  importance  of  territory 
characteristics  itnd.v  further  support  in  the  present  report. 

In  another  study.  Abrahams.  Neumann,  and  Kimland'  used  two  sample  groups  of  Navy 
recruiters  (Total  N-3S*ii  to  develop  a  scoring  key  for  the  Strung  Vocational  Interest  Blank 
(SVIBl  that  appears  to  !*•  a  promising  recruiter  selection  device  Weighted  scores  were 
computed  for  a  hold-out  group  of  17#  recruiters  who  had  not  participated  in  development 
of  the  scoring  key.  When  th<*v*  vuhjeeta  were  divided  into  fourths,  the  top  quarter  contained 
about  three  times  as  many  "effective"  recruiters  as  the  hot  tom  fourth.  All  subjects  had  been 
selected  by  their  supervisors  as  lieing  among  the  five  most  effective,  or  the  five  least 
effective,  in  their  stations.  The  SV1B  appears  promising,  hut,  ai  the  authors  indicate,  further 
research  is  needed  to  determine  how  well  the  instrument  would  discriminate  among  an 
otherwise  unselected  group  of  recruiter  applicants. 

In  the  field  of  salesmanship  research,  an  interesting  study  was  reported  by  Gnkscheit.1 
Two  sample  groups  of  "high  effect"  and  "low  effect"  salesmen  viewed  scenes  of  customer 
or  proepect  behavior  on  closed  circuit  TV.  After  each  of  16  scenes,  the  tape  was  stopped 
and  the  subject  vas  asked  to  desenbe  in  writing  the  verbal  and  nonverbal  behavior  he  had 
observed,  and  to  indicate  what  strategy  or  tactics  he  would  use  next  to  close  the  sale.  The 
high  effect  and  low  effect  salesmen  differed  principally  as  follows:  (a)  The  high  effect 
salesmen  observed  and  correctly  interpreted  more  nonverbal  cues;  (b)  they  tried  a  greater 
variety  of  strategies  early  in  the  interview,  but.  after  settling  on  one,  tended  to  stay  with  it. 
In  contrast,  low  effect  salesmen  tended  to  continue  changing  strategies  throughout  the 
interview.  Gnkscheit  indicates  that  a  more  comprehensive  replication  jf  his  study  is  needed 
before  his  findings  should  be  used  in  selection,  training,  and  evaluation.  The  extent  to  which 
these  selling  skills  are  amenable  to  training,  nr  are  identifiable  prior  to  training,  is  not 
known.  Nevertheless,  Gnkscheit *s  work  is  important  and  certainly  merits  serious  attention. 


THE  CRITERION  PROBLEM 

To  attempt  to  develop  an  effective  recruiter  selection  instrument  is  clearly  an  ’ 
ambitious  undertaking.  Because  of  the  following  considerations,  however,  the  attempt  was 
mMie:  (a)  The  need  for  such  an  instrument  still  exists  and  is  even  greater  since  the  end  of 
the  draft,  and  (b)  most  previous  attempts,  in  the  fields  of  both  recruiter  and  salesman 
selection,  have  lacked  a  reliable  and  valid  criterion  of  effective  performance.  Any  selection 
study  is  doomed  to  failure  if  the  criterion  to  be  predicted  is  unreliable,  or  is  heavily  loaded 
with  variance  unrelated  to  the  effective  job  performance. 

Supervisor  ratings,  which  are  often  used  as  a  criterion  in  selection  research,  very  often 
are  limited  in  reliability  and  validity.  Even  with  the  best  of  intentions,  supervisors  are  often 
influenced  by  characteristics  that  are  not  truly  related  to  the  subject’s  job  effectiveness.  For 
example,  a  recruiter  might  he  rated  high  primarily  because  he  is  likable,  and  has  a  good 
military  bearing  and  a  good  production  record.  Yet  the  good  production  record  might  be 
the  result  of  having  been  assigned  to  a  very  fertile  territory. 

School  grades  (or  training  course  grades)  are  another  criterion  often  used  in  selection 
research.  Generally,  though,  grades  reflect  the  ability  to  learn  verbal  materials,  rather  than 
to  perform  on  a  job.  Moreover,  they  are  subject  to  unintentional  grader  bias,  and  often  have 
only  a  modest  correlation  with  post-training  performance  on  the  job. 


1  N.M.  Abrahams.  I.  Neumann,  and  B.  Rimland.  Preliminary  Validation  of  an  Interttt  Imentory  for 
Selection  of  Navy  Recruiter s.  Rev-arch  Memorandum,  SRM  7j-3,  Naval  Personnel  and  Training  Research 
Laboratory,  San  Diego,  California.  1973. 

JG.M.  Gnkscheit.  "An  Experimental  Investigation  of  Persuasive  Communication  in  Selling,"  paper 
presented  at  the  American  Marketing  Association  Fall  Conference,  Washington,  1973. 
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Raw  production  figures,  while  attractive  because  of  their  simplicity  and  obviously  high 
relevance  to  organizational  goals,  are  a  sadly  deficient  criterion  because  they  are  so  strongly 
influenced  by  opportunity  bias.  Such  figures  are  a  joint  function  of  the  individual  worker’s 
characteristics  and  those  of  the  work  setting— for  example,  the  fertility  of  the  sales  territory, 
and  the  quality  of  the  worker’s  tools  and  of  the  management  system  in  which  he  functions. 

The  need  for  a  good  criterion  of  recruiter  effectiveness  is  clear.  It  was  made  the  first 
order  of  business  in  the  present  study. 


OVERALL  STUDY  PLAN 

The  overall  study  plan  called  for  three  interlocking  steps  of  data  collection 
and  analysis: 

<  1  >  Development  of  a  criterion  of  recruiter  effectiveness. 

(2)  Development  and  tryout  of  a  set  of  potential  recruiter  selection  tests. 

(3)  Revision  of  the  tests  and  cross-validation  on  a  new  sample  of  recruiters. 

Step  1  would  be  carried  out  as  follows:  A  random  sample  of  500  recruiters  would  be 
identified  and  data  obtained  on  their  individual  production  records,  their  effectiveness  as 
ji  dged  by  their  supervisors,  and  characteristics  which,  on  a  priori  grounds,  might  influence 
the  fertility  of  their  territories.  It  was  hoped  that  the  territory  data,  plus  the  rating  data, 
would  account  for  most  of  the  variance  in  production  scores.  If  adequate  correlations  were 
found,  the  territory  data  would  be  used  to  predict  the  theoretical  yield  of  each  territory. 
Each  man  would  then  have  a  criterion  score  computed  for  him  that  would  indicate  how  well 
he  had  performed  in  relationship  to  the  theoretical  potential  of  the  territory.  Step  1  was 
completed  on  the  basis  of  data  on  400  recruiters. 

Step  2  called  for  the  assembly  of  preliminary  versions  of  test  instruments  likely  to 
measure  personal  characteristics  relating  to  recruiter  effectiveness.  The  tests  were  to  be  tried 
out  on  two  contrasting  groups:  50  of  the  best  recruiters  in  the  country  and  50  of  the 
poorest.  Items  and  tests  that  discriminated  between  the  two  groups  would  be  assembled  into 
a  revised  test  battery,  which  would  then  be  cross-validated  in  Step  3.  Step  2  was  completed 
approximately  as  planned— the  sampled  groups  consisted  of  45  high-rated,  and  43 
low-rated,  recruiters. 

Step  3,  a  cross-validation  of  the  revised  test  battery,  was  not  accomplished.  Only  about 
20  items  were  identified  that  appeared  to  discriminate  between  the  contrasting  groups  of 
recruiters  (see  Chapter  3).  Theoretically  these  can  be  assembled  into  a  short 
paper-and-pencil  test  that  may  be  worth  evaluating  in  an  operational  setting,  but  does  not 
merit  a  major  cross-validation  effort.  Some  suggestions  for  evaluating  the  usefulness  of  this 
brief  test  are  included  in  Chapter  3. 
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Chapter  2 

DEVELOPMENT  OF  A  CRITERION  OF 
RECRUITER  EFFECTIVENESS 


INTRODUCTION 

Readily  available  indices  of  recruiter  effectiveness,  such  as  raw  production  figures  or 
the  percentage  of  ohje.  'ivc  achieved,  are  prohably  contaminated  in  varying  degrees  by 
"opportunity  bias."  This  term,  which  comes  from  the  field  of  industrial  psychology, 
refers  to  the  fact  that  workers  may  vary  in  the  amount  (or  quality!  of  opportunity  they 
have  to  produce  (make  sales).  For  example,  a  recruiter  assigned  to  a  very  fertile  (good) 
territory  will  probably  huve  a  high  production  record  almost  regardless  of  his  ability  or 
efforts.  The  same  person,  if  assigned  to  a  very  poor  territory,  might  have  a  very  low 
production  record.  The  question  is:  How  can  a  criterion  be  developed  that  will  not  tie 
disturbed  by  factors  outside  the  recruiter's  control? 

A  preliminary  study  by  Cravens  and  Woodruff  suggested  an  approach  for  coping 
with  the  problem  of  opportunity  bias.  After  pointing  out  that  sail's  volume  in  a  given 
territory  may  often  indicate  the  productivity  of  the  territory,  rather  than  of  the 
salesman,  they  attempted  to  identify  those  fuctors  outside  the  salesman's  control  thnt 
accounted  for  variance  in  territory  performance  (i.e.,  sales  volume).  Each  factor  was 
defined,  measured,  and  correlated  with  the  criterion  of  “sales  volume.”  A  multiple 
regression  equation  wits  developed  anil  used  to  predict  total  sales  for  each  territory.  These 
predicted  scores,  which  were  called  "benchmark  scores,"  represented  the  production  that 
a  salesman  of  average  ahility  and  motivation  might  be  expected  to  achieve  in 
that  territory. 

Next,  each  salesman's  actual  performance  was  expressed  its  n  percentage  of  his 
benchmark  score,  yielding  a  "Benchmark  Achievement  Score.”  Cravens  and  Woodruff 
found  that  the  rankings  of  25  salesmen  in  terms  of  Benchmark  Achievement  Scores 
correlated  +.t>l  with  their  rankings  in  terms  of  supervisory  ratings.  This  was  statistically 
significant  (p<  .001 ),  indicating  that  the  benchmark  system  was  reasonably  consistent 
with  management's  opinions.  On  the  other  hand,  benchmark  rankings  correlated  only  .17 
(nonsignificnntlv)  with  rankings  by  quota  achievement,  suggesting  that  the  benchmark 
achievement  criterion  was  the  more  valid  in  terms  of  its  agreement  with  manage¬ 
ment's  opinion. 

This  was  the  approach  to  criterion  development  selected  us  the  model  for  the 
research  conducted  in  this  study. 


ORIGINAL  LIST  OF  POTENTIAL  PREDICTORS 
OF  TERRITORY  FERTILITY 

During  an  October  1B7:1  meeting,  personnel  from  lIumRRO,  the  U.S.  Army 
Research  Institute  for  the  Behavioral  and  Social  Sciences,  and  the  U.S.  Army  Recruiting 

1 0»vi<1  W  I'Tuvcns  sn<l  Hubert  R  Woodruff  “An  Appronch  for  Pel rrmininj  Criteria  of  Salr* 
Performance."  in  Journal  of  Applifil  I'fychotogy,  vol  S7,  no  3.  1973,  pp.  212  247. 


Command  attempted  to  utoitt ify  a*  many  factor*  aa  possible  that  might  reasonah'y  Ih< 
expected  to  influence  the  fertility  of  recruiting  territories.  (Collection  of  data  on  some  of 
these  factor*  wm  not  operationally  feasible  ami  they  hat!  to  lie  omitted  from  the  study  ) 
The  factor*  originally  intended  for  inclusion,  and  the  rationale  for  including  each,  are 
described  in  the  following  paragraphs. 

Ratio  of  QMA  to  M A.  Territory  boundaries  are  generally  drawn  so  aa  to  give  each 
recruiter  approximately  flu*  same  Qualified  Military  Avadables  (QMAl.  usually  900-1000. 
Another  figure,  Military  Availuhhw  (MAI,  refers  to  the  total  male  imputation  aged  17-21. 
in  a  particular  territory.  The  ratio  of  QMA  to  MA  indicates  the  proportion  of  male*  in 
this  age  group  who  probably  would  lie  acceptable  for  military  service  (liases!  on  post 
AEKKS  rejection  rates,  etc. i.  The  higher  this  ratio,  the  greuter  the  probability  that  any 
given  applicant  will  prove  acceptable.  Thus,  this  value  should  lie  positively  correlated  with 
territory  fertility. 

Geographical  Sue  of  Territory.  A  recruiter  with  a  large  territory  has  a  widely 
dispersed  population  to  deal  with.  Since  he  will  have  to  spend  a  greater  amount  of  tune 
in  travel,  he  will  have  less  tune  to  spend  on  actual  recruiting  activities.  This  factor  should 
be  inversely  correlated  with  territory  fertility. 

Location  (if  Recruiting  Station.  There  are  generally  four  different  ty|ies  of  locations 
for  recruiter  stations:  (a)  Post  Office  or  other  federal  building,  (hi  suburban  shopping 
center,  (c)  store  front  or  other  congested  business  area,  and  (ill  professional  office 
building.  It  is  possible  that  the  type  of  location  of  the  recruiting  station  influences 
territory  fertility. 

Unemployment  Kate  in  Territory.  Young  men  art*  commonly  believed  to  be  more 
likely  to  enlist  in  the  Army  during  period*  when  civilian  job*  are  hard  to  find.  If  this  is 
true,  the  unemployment  rate  should  correlate  positively  with  territory  fertility. 

Median  Family  Income  It  is  reasonable  to  supi»ose  that  young  men  of  higher 
socioeconomic  status  are  more  likely  to  pursue  a  college  education  or  join  a  family 
business  than  to  volunteer  for  military  service.  Mis  ban  family  income  can  serve  as  an 
indicator  of  socioeconomic  status  and  cun  la*  indicated  by  consulting  Census 
Bureau  publications. 

Educational  Level  of  Community.  Presumably,  the  higher  the  educational  level,  the 
less  fertile  is  the  territory  as  a  source  of  recruits.  Information  on  median  school  years 
completed,  for  each  county  in  each  state,  is  provided  in  the  11*70  U.S.  Census. 

Racial  and  Religious  Composition  of  'Territory.  'The  racial  and  religious  composition 
of  a  territory  may  possibly  influence  its  fertility.  The  plan  was  to  seek  measures  of  these 
characteristics  and  to  examine  their  relationship  with  territory  production.  Possible 
source*  for  this  information  are  the  U.S.  Census  rej*orts  and  the  Rand  McNally 
Commtn'ul  .-I  tUm  and  Marketing  Guide. 

- Average-- Market  Slum*.  Tms  term  refers  to  the  proportion- of  all  military  enlistees 

who,  over  a  specified  period  of  time,  chose  the  Army.  It  can  In*  regarded  as  an  index  of 
the  relative  popularity  of  the  Army  compart'd  with  the  other  Services. 

- Average  Number  of  Enlistments  per  Recruiter  in  Recruiter's-  District  Recruiting 

Command  ^DKC).  'This  number  should  l*e  a  general  indicator  of  the  ijuality  of  the 
recruiter’s  territory,  reflecting  deep-seated  traditions  toward  military  service,  as  well  as 
complex  economic  and  social  factorx.  This  value  should  correlate  positively  with  territory 
fertility. 

Proximity  to  a  Major  Army  Post .  Recruiter  personnel  commonly  lieliev.*  that  this 
factor  acts  to  depress  enlistment  rates.  Accordingly,  once  the  samole  of  recruiters  had 
been  selected,  a  query  was  to  In*  addressed  to  each  DRC  concerned,  requesting  the  name, 
population  of,  and  distance  to  the  nearest  Army  installation. 

Proximity  to  a  Major  Navy  or  Air  Force  Installation.  This  factor  is  thought  by 
many  recruiting  personnel  to  be  positively  related  to  Army  enlistment  rates  Information 
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on  this  factor  would  he  solicited  from  appropriate  DRC  personnel.  Each  territory  would 
be  categorized  us  either  near  or  not  near  a  major  Navy  or  Air  Force  installation. 

Proportion  of  Territory  That  is  Metropolitan.  Suburban,  or  Rural,  Statistical 
analyses  of  this  information— which  originally  was  to  be  extracted  from  USAREC 
Form  100-  -should  reveal  whether  any  one  of  these  territorial  compositions  is  significantly 
superior  to  the  others. 

ASVAB  Saturation.  The  Armed  Services  Vocational  Aptitude  Battery  (ASVAB)  cun 
be  administered  to  civilian  high  school  students  at  no  cost  to  either  the  students  or  their 
schools.  How  extensively  the  battery  is  used  in  a  given  school  system  is  probably 
influenced  both  by  the  receptivity  of  school  officials  and  the  promotional  efforta  of  local 
recruiting  personnel. 

Since  the  degree  of  ASVAB  saturation  might  reasonably  b*  supposed  to  be 
positively  related  to  territory  production,  information  was  obuined  from  USAREC 
concerning  the  total  number  of  high  school  students,  within  each  DRC  area,  who  were 
administered  the  ASVAB  during  FY  1A. 

Number  of  17-21 -Year-Olds  who  are  High  School  Seniors-  Presumably  the  more 
there  are  in  tins  age  group,  the  more  fertile  the  territory. 

Number  of  17-21  Year-Olds  who  are  Enrolled  in  College.  Presumably,  this  factor 
would  correlate  inversely  with  territory  fertility. 

Amount  of  Recruiting  Experience.  While  this  is  clearly  not  a  territorial  char¬ 
acteristic,  it  is  a  factor  outside  the  recruiter’s  immediate  control  that  probably  influences 
the  yield  of  the  territory.  Since  a  highly  experienced  recruiter  might  reasonably  he 
expected  to  produce  more  enlistments  than  a  novice,  it  is  proper  to  take  the  recruiter’s 
experience  into  account  in  attempting  to  predict  the  yield  of  a  territory.  (The  number  of 
months  on  production  duty  as  a  recruiter  served  as  a  measure  of  experience.) 

OBTAINING  A  SAMPLE  OF  RECRUITER  TERRITORIES 

The  overall  research  plan  called  for  selecting  a  random  sample  of  500  recruiters’ 
names  and  compiling  territorial  information  about  each.  It  was  originally  thought  that 
sample  selection  and  information  compilation  could  he  largely  accomplished  by  using 
USAREC’s  computerized  information  system,  but  some  of  the  necessary  information  on 
individual  recruiters  and  on  recruiting  station  territories  waa  not  available.  USAREC 
officials  then  devised  an  alternate  procedure.  An  official  letter  was  sent  from  USAREC  to 
the  commander  of  each  of  the  five  Recruiting  Districts  (now  called  Regional  Recruiting 
Commands)  directing  him  to  provide  names  and  other  information  about  100  individual 
recruiters.  To  ensure  randomness,  names  were  to  be  selected  by  means  of  the  terminal 
digits  of  Social  Security  Account  numbers,  and  were  to  include  only  men  who  (a)  hud 
been  on  production  in  their  current  assignment  from  July  to  December  1973,  and  (b)  had 
been  assigned  individual  objectives  for  that  period.  (The  USAREC  letter  and  the  associ¬ 
ated  data  reporting  sheet  are  reproduced  in  Appendix  A.) 

Territorial  information  was  compiled  by  USAREC'  personnel,  partly  from  available 
records,  and  partly  by  conducting  a  “special  market  report.” 

DESCRIPTION  OF  THE  SAMPLE  OF  RECRUITER  TERRITORIES 

Each  of  the  five  Regional  Recruiting  Commands  (RRC)  was  directed  by  USAREC  to 
supply  approximately  100  names,  for  a  total  of  500.  The  number  of  usable  subjects 
supplied  hy  ench  RRC'  is  shown  in  Table  1. 
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Table  1 
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Criterion  Development  Study  Sample 


Regional 

Racruitmg 

Command 

Numbar  of 
Dittnct  Raciuitmg 
Command!  in 
Rtgion* 

Numtwr  of 
Dtttrtct  Recruiting 
Commands  in 
Samp)* 

Number  ot 
Recruiters 
ion  Production) 
in  RRC 

Number  of 

Recruiters 
in  Sample 

Percent  ot 
Recruiter* 
in  Semple 

Northeastern 

15 

14 

905 

97 

10.7 

Southeastern 

11 

11 

772 

92 

11.9 

Southwestern 

11 

9 

687 

82 

11.9 

Midwestern 

15 

5 

1140 

66 

6.7 

Western 

10 

8 

687 

63 

9.1 

Total 

66 

46 

4191 

40 

*DRC«  outside  the  contmentel  U.S  (Sen  Juan,  Honolulu,  and  Anchorepe)  war*  dieregerdad. 


The  Midwestern  Recruiting  Command  is  clearly  not  as  well  represented  as  the 
others;  only  five  of  its  IS  cities  are  included.  However,  the  present  study  is  a  corre¬ 
lational  study  of  the  relationship  between  various  territory  characteristics  and  territory 
production,  rather  than  a  descriptive  survey.  This  means  that  the  sample  is  adequate  if 
each  of  the  predictor  variables  (territory  characteristics)  is  represented  over  an  adequate 
range  of  values  and  there  are  no  major  interactions  between  place  and  other  char¬ 
acteristics  in  determining  correlations.  It  seems  reasonable  to  believe  that  the 
10  midwestem  cities  not  included  in  the  sample  are  essentially  similar,  on  the  territorial 
characteristics  of  interest,  to  the  46  throughout  the  U.S.  which  are  included,  and  that 
there  are  no  complex  interactions.  ( A  complete  list  of  DRC’s,  and  the  number  of  subjects 
supplied  by  each,  appears  in  Appendix  B.)  . . . 


DEFICIENCIES  IN  THE  TERRITORIAL  INFORMATION 

Ideally,  each  item  of  territorial  information  should  refer  to  the  specific  geographical 
area  that  constitutes  a  particular  recruiter's  area  of  responsibility.  However,  such  fine¬ 
grained  information  was  not  obtainable  within  the  existing  time  and  cost  constraints. 
Accordingly,  most  itemvof  territorial  information  actually  apply  to  the  recruiter’s  station — 
zone  rather  than  to  his  particular  territory.  It  is  likely  that  in  some  instances  the  two  are 
not  similar. 

The  original  research  design  included  a  verification  step  that  involved  contacting  by 
mail  the  area  supervisor  for  each  recruiter  in  the  sample,  and  asking  him  to  make  any 
adjustments  in  our  territorial  information  he  considered  necessary  to  make  it  accurate. 
However,  the  territorial  information  became  available  to  HumRRO  too  late  for  that  step 
to  be  taken. 

The  values  for  three  other  potential  predictors— unemployment  rate,  median  family 
income,  and  educational  level  of  community— were  obtained  from  the  U.S.  Census 
Bureau,  County  and  City  Data  Book  (1972),  in  which  data  are  organized  only  by  county 
or  city.  This  caused  problems,  since  many  of  the  recruiting  territories  included  in  our 
sample  comprised  port*  ms  of  several  counties.  Using  county  data  to  calculate  census  data 
for  such  territories  would  have  been  time-consuming,  and  would  have  involved  many 
dubious  assumptions.  It  was  decided  to  include  census  data  only  for  those  sample 
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territories  whose  boundaries  were  coterminous  with  county  boundaries.  Of  the  400  cases, 
21 1 -concentrated  in  the  densely  populated  Northeastern  Regional  Recruiting 
Command- met  this  condition. 

Most  of  the  data  unulyse*  described  m  the  following  section  were  baaed  oa  the  total 
sample  of  400  cases,  excluding  the  three  census-type  variables.  A  few  analyses  were  based 
on  the  smaller  sample  of  211  cases  on  which  census-type  information  was  available. 


CORRELATION  OF  PREDICTOR  VARIABLES  WITH 
TOTAL  PRODUCTION  SCORES 

The  results  described  in  this  section  were  obtained  by  subjecting  12  predictor 
variables  (excluding  the  three  census-type  vanahles)  io  a  step-wise  multiple  correlation 
with  “total  production  scores,”  that  is,  the  total  number  of  accessions— Nonpoor  Service 
(NPS),  Prior  Service  (I’S),  and  W AC's— obtained  by  each  subject  from  July  to 
December.  1 97.1 . 

Although  in  this  report  we  have  referred  to  attempts  to  predict  “territory  fertility, ” 
our  efforts  could  perhups  be  defined  more  precisely  as  attempts  to  determine  the  extent 
to  which  territorial  characteristics  can  lie  used  to  predict  the  yield  of  a  territory.  This 
yield  can  he  measured  objectively  only  by  the  actual  production  score  obtained  hy  the 
recruiter  who  worked  the  territory.  Therefore,  since  our  list  of  potential  predictors 
includes  only  those  variables  outside  the  recruiter's  direct  control,  any  predictive  accuracy 
ohtained  must  be  attributed  primarily  to  nonrecruiter  variables. 

A  study  of  the  12  predictor  variables  used  in  this  analysis,  arranged  in  dearending 
order  of  their  contribution  to  predicting  the  criterion  of  total  production,  shows  that  the 
best  single  predictor  is  “Average  Production  per  Recruiter  in  the  Subject’s 
DRC"  (Table  21.  The  correlation  coefficient  is  ♦  696,  which  account*  for  48%  of  the 
variance  in  production  scores.  This  means  that  station  (or  territory)  productivity  is 
strongly  influenced  by  characteristics  of  the  particular  station,  which,  in  turn,  could  be 
social  or  cultural  features  not  measured  in  the  present  study.  (None  of  the  social  or 
cultural  features  measured  in  this  study  were  found  to  relate  strongly  to  productivity.) 

It  is  also  jmssible  that  “Average  Production  per  Recruiter  in  the  DRC"  is  itself  a 
function  of  local  personnel  management  practices,  and  of  the  quality  of  the  individual 
recruiters.  Whether  any  selective  factors  operate  in  the  assignment  of  recruiter*  to  DRCs 
is  not  known. 

It  should  be  noted  that  the  large  value  of  this  correlation  (■♦■.696)  is  to  a  small 
extent  artifaclual,  since  the  recruiters  whose  production  records  constituted  the  criterion 
were  themselves  contributors  to  the  average  production  of  their  DRC.  However,  since  our 
total  N  of  400  is  only  about  a  10"  or  smaller  sample  of  all  recruiters  in  the  United 
Stat«*s.  this  is  not  a  serious  contamination. 

It  remains  true,  as  indicated  by  the  correlation  coefficient  (■♦.696),  that  recruiters 
tend  to  produce  at  a  rate  that  is  characteristic  of  their  DRC. 

The  second  best  predictor  is  “Average  Market  Share  for  Station  Zone”  (Table  2). 
This  variable  can  he  viewed  as  an  index  of  the  relative  popularity  of  the  Army,  as 
compared  to  the  other  services.  When  this  variable  is  added  to  the  prediction  equation, 
the  multiple  K  increases  to  ♦  710,  and  the  amount  of  criterion  variance  accounted  for 
rises  to  50.5"'\  A  third  variable,  “Proportion  of  Zone  Which  is  Suburban,"  adds  a  minute 
amount  to  the  multiple  II,  which  then  becomes  .714. 

The  remaining  variables  listed  in  Table  2  add  only  trivially  to  predictive  power.  The 
reasons  why  several  potential  predictors  which,  on  a  priori  grounds  appeared  premising, 
do  not  rank  high  can  he  seen  hy  studying  the  “Simple  r"  and  “Partial  r“  columns.  The 
values  in  the  “Simple  r"  column  are  the  simple  correlations  between  the  predictor 
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Tabto  2 

Stapwisa  Multipto  Correlation  (A)  of  12  Predictor  Variable*  With 
Total  Production  Over  a  Six-Month  Period 

(N  -  400) 


r  IVUHtW  VlilllaM 

Simpler* 

Partial  r* 

Suet  solve 
Mvlttpt*  A* 

Proportion  of 
Variance 
Accounted  For 

Average  Production  per  Recruiter  in 
Subiecl't  ORC 

696* 

.389* 

.696* 

.486 

Average  Market  Share  tor  Station  Zone 

649* 

.203* 

.710* 

.506 

Proportion  of  Zone  Which  is  Suburban 

-  092 

068 

.714  + 

.609 

Months  o(  Experience  as  Recruiter 

-.012 

.09 

.718* 

.512 

Number  of  High  School  Seniors  in  Zone 

-.064 

.041 

.717  * 

.514 

Average  Production  per  Recruiter  for 
Sublet's  RCC 

.596* 

.027 

.717  * 

.615 

Number  of  ASVAB's  in  Subject's  ORC 

.173* 

.029 

.718* 

.515 

Number  of  17-21-YearOlds  in 

College  in  Station  Zone 

-  040 

.018 

.718  + 

.515 

Site  of  Station  Zone  in  Square  Miles 

.096 

-  011 

.718* 

.515 

Proportion  of  Zone  Which  is  Rural 

.126* 

.069 

.718  • 

.615 

Proportion  of  Zone  Which  is  Metro 

-.034 

.076 

.720  * 

.518 

Ratio  of  QMA  to  MA 

-.040 

.007 

.720* 

.518 

••Indleetes  statistical  elenlltcance  [p  <.061. 


variahlM  and  the  criterion.  While  several  of  theae  are  significantly  larger  than  zero,  they 
do  not  appear  important  in  the  multiple  R  because  they  were  largely  duplicating  other 
predictor*  with  which  they  were  correlated.  For  example,  "Average  Production  per 
Recruiter  for  Subject's  RRC”  correlated  +  59  with  the  criterion  of  total  production;  hut 
since  it  alao  correlated  highly  (r  -  .820)  with  “Average  Production  per  Recruiter  in 
Subject's  DRC,”  it  made  essentially  no  unique  contribution  to  prediction  and  rank*  only 
sixth  among  the  predictors. 

The  column  of  partial  r’s  show*  the  correlation  of  each  predictor  with  the  criterion 
when  all  other  variables  are  held  constant  (neutralised)  by  statistical  mean*.  The  fact  that 
most  of  the  partial  r’s  are  small  and  nonsignificant  is  consistent  with  the  fact  that 
including  them  in  the  multiple  regression  would  add  little  to  predictive  power. 

Now  let  us  consider  the  results  obtained  when  all  16  potential  predictors  are  put 
into  the  regression  equation,  that  is,  when  we  add  the  three  census  variables,  and 
necessarily  reduce  the  N  to  the  number  for  whom  census  data  are  available  (N  -  211).  In 
a  word,  prediction  worsens;  the  R  shrinks  to  ,59  and  accounts  for  only  44%  of  criterion 
variance.  This  shrinkage  probably  results  from  the  fact  that  the  subset  of  recruiter 
territories  is  more  homogeneous  than  the  population  as  a  whole,  thereby  producing  a 
"restriction  in  range."  As  indicated  earlier,  the  Northeastern  Regional  Recruiting 
Command  contributed  a  disproportionate  share  of  subjects  for  this  analysis  (about  40% 
of  the  211  cases). 
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CORRELATION  OF  PREDICTOR  VARIABLES  WITH  OTHER  CRITERIA 


The  kinds  of  analyses  described  in  the  previous  section  were  replicated  using  two 
other  criteria:  la)  percent  of  objective  achieved  over  a  6-month  period,  and  (b)  total  point 
score1  over  a  6  month  period.  The  maximum  R  obtained  using  12  variables  and  all  400 
cases  was  ♦.619  for  the  former,  and  ♦.733  for  the  tatter.  Evidently,  total  point  score  is 
more  predictable  than  total  production  score. 

In  all  three  analyses,  the  highest  ranking  predictors  were  the  two  previously 
described:  (a)  "Average  Production  per  Recruiter  in  Subject's  DRC,"  and  (b)  “Average 
Market  Share  for  Station  Zone.” 


COMPUTATION  OF  BENCHMARK  ACHIEVEMENT 
SCORES  (BAS  SCORES) 


BAS  scores  were  computed  by  the  following  formula: 


BAS  Score 


Actual  Production  „ 
Predicted  Production 


"Actual  Production”  scores,  which  were  supplies!  hy  USA  RFC,  represent  the  total 
number  of  accessions  to  the  Army  produced  by  each  subject  from  July  to 
December.  1973.  N 

Predicted  production  scores  were  computed  via  the  multiple  regression  equation 
represented  in  Table  2.  Only  the  top  three  predictor  variahles  were  used,  since  together 
they  account  for  approximately  51%  of  the  variance  in  production  scores,  and  adding  the 
other  nine  variables  would  increase  the  amount  of  variance  explained  by  less  than  one 
percentage  point.  The  three  variables  were: 

(ll  Average  Production  per  Recruiter  in  Subject’s  DRC. 

(2)  Average  Market  Share  for  Station  Zone. 

1 3)  Proportion  of  Zone  Which  is  Surburhan. 

The  distribution  of  BAS  scores  is  presented  in  Figure  1.  The  mean  score  is  99.1  and 
the  range  is  from  7  1  to  215.9.  The  general  appearance  of  the  distribution  suggests 
normality- that  is,  the  curve  is  basically  bell-shaped  In  a  perfectly  normal  distribution, 
68%  of  the  cases  would  be  within  one  standard  deviation  of  the  mean,  that  is,  between 
6-1.0  and  131.2.  Results  in  this  distribution  are  close  to  that,  with  73%  of  the  cases 
falling  within  these  limits. 


VALUE  OF  BAS  SCORES  AS  A  CRITERION  OF 
RECRUITER  EFFECTIVENESS 

The  value  of  BAS  scores  must  be  assessed  primarily  on  rational  or  judgmental 
grounds.  The  original  research  design  for  this  criterion  study  called  for  collecting 
sophisticated  ratings  of  the  overall  effectiveness  of  each  recruiter  in  the  sample  from  five 
different  supervisors,  but  there  was  not  enough  time  to  take  this  step.  If  such  ratings 
were  available,  it  would  be  interesting  to  find  out  how  much  of  the  variance  in  territory 
production  they  would  account  for— and  to  determine  how  they  correlate  with  BAS 
scores.  A  higher  correlation  than  that  between  ratings  and  production  scores  would 


'a*  an  incentive,  recruiter!  are  awarded  varying  number*  of  “pointa”  for  each  aeceeaion— the 
number  of  pointa  v*-;-:-;  ,-J’h  the  ‘'quality"  of  the  acceaaion.  For  example,  more  pointa  are  awarded  for 
enliating  a  high  echool  graduate  than  a  non-high  eehool  graduate. 
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Figure  1  Distribution  of  Benchmark  Achievement  Scores  of  400  Recruiters 


suggest  that  BAS  scores  are  a  more  valid  indicator  (criterion)  of  recruiter  effectiveness  ; 

than  either  production  scores,  or,  perhaps,  scores  based  on  percentage  of  j 

objectives  achieved.  1 

To  illuminate  the  meaning  and  possible  validity  of  BAS  scores,  their  correlations  ’ 

with  other  available  indices  of  recruiter  effectiveness  were  computed  (Table  3).  Since  BAS 
scores  were  designed  specifically  to  evaluate  a  recruiter’s  performance  in  relationship  to 
the  quality  of  his  territory,  it  is  not  surprising  that  they  correlate  only  .646  with  raw  • 

production  scores.  They  also  correlate  rather  low  with  “percent  of  objective  scores”  and  ’ 

with  total  point  scores.  Clearly,  BAS  scores  do  not  duplicate  the  functions  of  these  other  \ 

scores,  which  suggests  that  they  are  indeed  giving  due  weight  to  variations  in  quality 
of  territory.  . 

Table  3  ! 

Intercorrelations  Among  Various  Indices  of 
Recruiter  Effectiveness,  July  -  December  1973 


w* 

400) 

Indtcee  of 

Recruiter  Effectivenew 

Totat 

Production 

Percent  of 
Objective 
Score 

Totat 

Point  Score 

SAS*  Score 

BAS  Score 

.646 

.619 

.564 

.957 

Total  Production 

.847 

.929 

.729 

Percent  of  Objective 

.818 

.701 

Total  Point  Score 

.647 

•Simple  Achievement  Score. 
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SIMPLE  ACHIEVEMENT  SCORES  (SAS> 


The  SAS  scores  that  appear  in  Table  3  have  not  been  mentioned  previoualy.  It 
occurred  to  the  authors  that,  since  the  predictor  variable  of  predominant  importance  in 
computing  BAS  scores  is  ’‘Average  Production  per  Recruiter  in  Subject’*  DRC,"  a  Simple 
Achievement  Score  (SAS)  based  solely  on  the  individual’s  performance  compared  to  that 
average  might  be  equally  suitable-und  much  easier  to  compute.  Accordingly,  for  each 
subject  in  the  sample,  an  SAS  score  was  computed  as  follow*: 


SAS  Score 


Total  Production 
Average  Production  in  DRC 


X  100 


This  formula  produces  SAS  scores  that  express  each  man’s  production  as  a  percentage  of 
the  average  for  his  DRC.  As  Table  3  shows,  SAS  scores  correlate  extremely  high  with 
BAS  scores  (r  -  .957).  Thus,  the  two  score*  are  essentially  equivalent. 

As  a  criterion  of  recruiter  effectiveness,  the  SAS  score  appears  to  be  somewhat 
preferable  to  the  BAS  score  simply  because  it  is  more  easily  computed.  But  is  it  a  good 
criterion  measure’’  This  question  can  only  be  answered  judgmentally.  The  SAS  score 
clearly  provides  a  wide  range  of  variation  from  one  recruiter  to  another,  that  is,  ii  has 
good  discriminating  power.  It  is  intuitively  meaningful,  since,  in  effect,  it  rates  each  man 
against  the  average  for  his  DRC,  thus  taking  into  account  a  host  of  unknown  factors  that 
make  some  territories  better  than  others.  One  would  surmise  that  SAS  scores  would  be 
generally  acceptable  to  the  recruiters  themselves. 

It  is  hoped  that  future  research  can  be  done  in  which  our  recommended  new 
criterion  measures  (SAS  scores)  can  he  correlated  with  selection  test  scores.  If  the  SAS 
score  can  he*  predicted  more  accurately  than  older  entpria,  this  fact  will  itself  support  its 
validity  or  relevance. 
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Chapter  3 


DEVELOPMENT  AND  TRYOUT  OF  A 
RECRUITER  SELECTION  TEST  BATTERY 


GENERAL  PLAN 

In  developing  a  recruiter  selection  test  battery,  personal  characteristics  that  might 
reasonably  be  expected  to  contribute  to  effectiveness  as  a  recruiter  were  identified  on  the 
basis  of:  (a)  examination  of,  and  deductions  from,  the  pilot  study  findings; 
(b)  conversations  with  personnel  from  Headquarters,  USAREC,  and  the  Washington 
Recruiting  Main  Station;  and  (c)  common  sense  considerations.  In  brief,  the  characteristics 
to  be  measured  were:  verbal  fluency,  sociability,  achievement  motivation,  empathy, 
rejection  tolerance,  maturity /responsibility,  and  a  variety  of  background  and 
demographic  features. 

The  general  plan  for  evaluating  the  testa  called  for  administering  them  to  two  groups 
composed,  respectively,  of  50  highly  successful,  and  50  very  unsuccessful,  recruiters.  Items 
or  tests  that  discriminated  between  these  contrasting  groups  would  be  assembled  into  a 
revised  (and  shorter)  selection  test,  which  would  then  be  cross-validated  on  a  new  sample  of 
recruiters.  The  criterion  to  be  used  in  the  cross-validation  study  would  be  that  developed 
according  to  the  procedures  described  in  Chapter  2. 


DESCRIPTION  OF  THE  TEST  INSTRUMENTS 

In  physical  format,  the  test  battery  consisted  of  12  test  booklets  and  one  verbal 
performance  test.  Some  tests  measured  more  than  one  characteristic  and  some 
characteristics  were  assessed  by  more  than  one  test.  A  variety  of  formats  were  used  for  the 
test  items,  including  true-false,  multiple  choice,  extent  of  agreement  or  disagreement,  and 
open-end  write-in  items.  In  addition  to  the  information  obtained  from  the  tests,  a  few  items 
of  information  were  obtained  from  each  subject’s  official  personnel  form  (e.g.,  aptitude  test 
scores,  race,  religion). 

The  descriptions  of  the  test  instruments  that  follow  are  organized  around  the 
characteristics  the  tests  were  intended  to  measure. 

Verbal  Fluency  Measures 

It  seems  obvious  that  an  effective  recruiter  must  be  able  to  talk  easily  in  a  variety  of 
social  situations.  “Effective  Speaking"  is  one  of  the  characteristics  on  which  applicants  for 
recruiting  duty  are  evaluated  (subjectively)  by  recruiter  selection  boards.  It  would  seem  that 
an  effective  recruiter  must  be  able  to  express  his  thoughts  readily,  if  not 
necessarily  grammatically. 

Most  existing  tests  of  verbal  fluency  are  written  tests  requiring  the  subject,  within  a 
short  time,  to  name  as  many  words  as  he  can  that  start  with  a  given  letter  or  pertain  to  a 
given  semantic  area.  However,  the  authors  believe  that  verbal  fluency  should  be  measured 
orally,  in  the  most  realistic  situation  possible.  Accordingly,  each  subject  was  asked  to  speak 
into  a  dictaphone  “mike”  and  pretend  that  he  was  making  a  sales  pitch  to  a  potential 
enlistee  who  knew  little  about  the  Army. 
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The  tot  administrator  ad  libbed  the  instructions  to  the  subjects,  somewhat  as  follow*: 

You  ore  being  asked  to  sjvuk  for  three  to  five  minutes  on  general  Army 
benefits  us  if  you  were  sjvakmg  to  a  prospect.  We  realize  that  your  presentation 
to  a  prospect  in  4  real  ituation  varies,  depending  on  your  initial  assessment  of  the 
individual  However,  our  purpose  is  to  find  out  how  nvruiter*  differ  in  their 
presentations,  so  we  simply  .isk  you  to  speak  on  general  Army  benefit*.  Imagine 
that  I  I  the  administrator)  am  a  pro*j»ect  interested  in  the  Army  but  unfamiliar 
with  the  lienefits  and  or  options  available  to  me  should  1  enlist. 

When  you  are  ready,  sav  so.  ami  we  will  begin. 

After  each  subject  hail  s|H>kci'i  for  at  least  two  minutes  and  reached  a  logical  stopping 
point,  the  recording  was  stopped  Occasionally  a  subject  would  slop  short  of  two  minutes, 
in  which  case  the  administrator  would  simply  terminate  the  exercise. 

A  few  subjects  obviously  bail  great  difficulty  in  carrying  out  the  assigned  task;  they 
complained  that  the  situation  was  unnatural.  In  such  instances,  the  administrator  repeated 
the  instructions,  elalmriitmg  on  them  with  more  detail,  anil  the  subject  then  complies!.  The 
vast  majority  of  the  subjects  grasp'd  the  idea  quickly  and  performed  without  difficulty. 

The  first  two  minutes  of  each  recording  wen*  transcribed  into  type  for  scoring 
purposes.  The  original  plan  was  to  develop  a  variety  of  scores  for  each  transcript,  following  a 
procedure  develojied  by  Preston  and  t’.arilner. 1  However,  tieeause  of  time  constraints,  only 
two  rather  simple  scon's  could  be  computed  These  wen*: 

*  Verbal  A:  Total  number  of  word*  produced.  For  those  few  subjects  who 

sto|  (Mil  short  of  two  minutes,  their  scon*s  were  extrapolated  to 
obtain  a  value  corresponding  to  what  they  would  have  presumably 
scored  m  two  minutes. 

•  Verbal  H  "Ah”  Katio.  The  total  number  of  "ah's"  uttered  was  divided  by  the 

total  number  of  wonts  uttered  Pn*sumubly,  a  mon*  verbally  fluent 
jicrson  would  have  a  lower  Ah  ratio. 


Sociability  Measures 

Sociability,  or  the  tendency  to  enjoy  interacting  with  people,  seemed  important  since  a 
recruiter  must  s|vnd  much  of  his  time  interacting  with  people,  who  often  are  strangers.  If  he 
did  not  receive  a  certain  satisfaction  from  these  encounters,  he  would  probably  be 
underactive  in  prospecting  and  deficient  in  sales. 

Four  of  the  HI  tests  in  the  battery  wen*  intended  to  measure  sociability.  Each  of  these 
is  describ'd. 

Personal  Preference  l  ost  No  This  lest  consists  of  I  I  items,  each  of  which  describes 
a  hypothetical  activity  that  could  la*  performed  either  alone  or  with  various  kinds  of 
companions  (wife,  friend,  acquaintance,  several  people).  The  subject  reads  each  activity  and 
assigns  rank  numbers,  1  through  5.  indicating  Ins  order  of  preference  for  the  different  ways 
of  performing  the  activity.  A  sample  question  reads: 

If  I  were  going  to  a  party.  I  would  prefer  to  go: 

_ a  with  my  wife  girl  friend 

b.  with  an  acquaintance 
_ c.  alone 

_ d.  with  a  friend 

e.  with  several  other  jvonle 


’josnM  Preston,  ami  ft.t’  Darner  "Dimension*  of  Oral  anil  Written  language  Flueney,"  In  Journal 
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Four  of  the  five  preferences  are  of  a  social  nature,  the  preference  "alone**  being  considered 
asocial.  A  subject  who  repeatedly  assigns  “5‘*  to  the  “alone**  preference  shows  a  high  level 
of  sociability  ;  if  he  repeatedly  assigns  “1”  to  "alone,”  a  low  level  of  sociability  is  indicated. 
The  test  is  scored  by  summing  the  ranks  assigned  to  “alone”  and  subtracting  14.  Thus, 
scores  can  range  from  zero  to  56. 

Personal  Preference  Test  No.  2.  Similar  to  the  previous  test  in  intent,  this  test  consists 
of  22  items,  only  11  of  which  are  scored.  All  items  require  the  ubject  to  express  his 
preference  about  companionship  when  performing  a  certain  activity.  For  the  11  scored 
items,  the  choice  is  between  performing  the  activity  alone  versus  doing  it  with  others.  Scores 
could  range  from  zero  to  11.  A  sample  item  reads: 

a.  Go  on  a  weekend  trip  with  some  other  people 

b.  Go  on  a  weekend  trip  alone. 

The  subject  is  asked  to  take  into  account  what  the  activity  is  anr  with  whom  he  would  be 
doing  it.  Although  individual  activities  are  repeated,  no  two  pair  of  activities  are  the  same. 

Personality  Inventory.  The  title  “Personality  Inventory”  is  an  arbitrary  label  for  a  test 
consisting  of  slightly  modified  versions  of  two  tests  developed  by  Dr.  Albert  Mehrabian,  of 
the  University  of  California,  Los  Angeles.1  Thirty-four  of  the  items  in  the  Personality 
Inventory  are  actually  Mehrabian 's  items  for  measuring  affiliative  tendency,  which  we  refer 
to  as  “sociability."  The  subject  must  indicate  his  degree  of  agreement  or  disagreement  on  a 
5-point  scale  (+2  (strongly  agree] ,  +1,  0,  *  1,  -  2  (strongly  disagree] )  to  statements  such  as: 
“When  I’m  introduced  to  someone  new,  I  don’t  make  much  effort  to  be  liked,”  and  “When 
I’m  not  feeling  well,  I  would  rather  be  with  others  than  alone.” 

To  obtain  a  perfect  score,  half  of  the  34  items  must  be  marked  +,  to  indicate 
sociability;  the  other  half  must  be  marked  minus.  Items  marked  either  +2  or  -2  indicate 
maximum  sociability.  For  a  total  score,  the  minus  sign  for  each  of  the  subject’s  negative 
responses  for  a  negative  item  must  be  changed  to  a  plus  and  all  responses  summed.  Scores 
can  range  from  zero  to  68. 

Social  Activities  Questionnaire.  This  questionnaire  attempts  to  determine  the  extent 
of  the  subject’s  social  life  and  the  kinds  of  activities  he  enjoys.  Nominally,  there  are  17 
items,  but  several  of  them  have  scorable  components.  Topics  dealt  with  include:  type  of 
residence  occupied,  length  of  residence  in  the  present  neighborhood,  number  of  neighbors 
considered  close  friends,  frequency  of  visits  to  'riends,  and  frequency  of  social  functions 
such  as  parties,  movies,  night  clubs.  In  addition  to  queries  about  how  often  he  engaged  in 
these  activities,  the  subject  was  asked  how  often  he  would  like  to  engage  in  them. 

Achievement  Motivation  Measures 

Achievement  motivation,  or  the  urge  to  work  hard  to  achieve  self-appointed  goals,  is 
thought  to  be  a  positive  characteristic  of  a  good  recruiter.  Such  a  person  would  be 
thought  of  as  hardworking,  industrious,  persevering,  and  energetic.  The  following  three 
tests  were  designed,  either  wholly,  or  in  part,  to  measure  achievement  motivation. 

Personal  Opinion  Survey.  This  test  consists  of  35  maxims  purporting  to  express  a 
philosophy  related  to  achievement  motivation.  They  are  simplified  statements  made  by 
various  famous  Americans,  all  of  which  say  something  about  life  or  men  in  general.  Using 
a  five-point  scale  (+2,  +1,  0,  -1,  -2)  the  subject  indicates  his  degree  of  agreement  or 


1  Permission  to  use  these  tests  on  sn  experimental  basis  was  granted  by  Dr.  Mehrabian.  In  their 
original  form  they  were  called  measures  of  Affiliative  Tendency  and  of  Male  Achieving  Tendency.  For  a 
complete  description  of  the  original  tests,  see  A.  Mehrabisn.  “Measures  of  Achieving  Tendency,”  in 
Educational  and  Psychological  Measurement,  vol.  29,  1969,  pp.  445-451  and  A.  Mehrabian.  “The 
Development  and  Validation  of  Measures  of  Affiliation  Tendency  and  Sensitivity  to  Rejection,”  in 
Educational  and  Psychological  Measurement,  vol.  30,  1970,  pp.  417-428. 


disagreement  with  rx'h  maxim.  A  sample  item  reads:  "What  a  man  does,  that  he  has.  In 
himself  is  hts  mi|(ht." 

Personality  Inventory  (even  numbered  items,  2  52).  These  26  items  constitute  a 
slightly  modified  version  of  Mehrabian’s  measure  of  Male  Achieving  Tendency.  For  a 
complete  descnption  of  the  original  test,  see  Mehrabian. I-* 

Background  Information _ Forms.  Based  upon  ideas  expressed  by  McClelland,*  a 

number  of  biographical  items  were  devised  which,  according  to  McGelland's  findings  or 
theories,  might  he  expected  to  measure  achievement  motivation.  The  items  inquired 
about  such  matter*  as  the  nature  and  extent  of  the  subject's  participation  in  competitive 
sports,  the  kinds  of  jobs  he  had  held,  hts  attitudes  toward  a  variety  of  high  status  jobs, 
and  the  educational  level  of  his  parents. 

The  test  itself  consisted  of  40  multiple-choice  and  multiple-check  items  which 
were  scored  empirically.  That  is  to  say,  there  were  no  predetermined  right  or  wrong 
answers.  The  intent  was  to  determine  empirically  whether  any  items  were  answered 
differently  by  good  and  jioor  recruiteia. 

Empathy  Measures 

Empathy  is  defined  here  as  the  ability  to  understand  the  point  of  view  of  others  and 
to  correctly  perceive  the  impact  one  is  making  on  another.  McMurry*  has  argued 
convincingly  that  the  super-salesman  possesses  a  high  degree  of  empathy,  coupled  with  a 
high  degree  of  what  he  calls  "egodnve"  (the  urge  to  win).  In  other  words,  the 
super-salesman  must  be  capable  of  fully  grasping  the  prospect's  point  of  view  but,  to  be 
able  to  close  the  sale,  he  must  not  permit  excessive  sympathy  to  neutralize  his  urge 
to  win. 

Four  instruments  were  used  in  the  attempt  to  measure  empathy. 

Knowledge  of  lYospects  Test  No.  1.  Both  of  the  Knowledge  of  Prospects  tests  are 
based  on  the  rationale  that  a  recruiter  who  is  accurately  informed  about  the  political  and 
social  attitudes  of  today’s  young  men  will  be  more  empathic  with  them.  He  should 
understand  them  better  and  be  more  effective  in  influencing  them  to  enliat  in  the  Army. 

Information  obtained  from  the  Purdue  Poll  No.  89(1970),  which  surveyed 
American  high  school  students  (grades  10-12),  resulted  in  22  True-Falae  item*  and  40 
multiple-choice  items  concerned  with  student  thoughts  on  prejudice,  poverty,  peace, 
population,  pollution,  and  so  forth. 

Part  I  of  this  instrument  asks  the  recruiter  to  respond— True  or  False— to  22 
statements  describing  “the  typical  male  high  school  senior."  If  he  thinks  the  statement  is 
more  often  true  than  not,  he  is  to  mark  True.  Otherwise,  he  marks  False.  A  sample 
item  is: 

“He  is  primarily  interested  in  going  to  college  after  he 
finishes  high  school  and  has  little  if  any  interest  in  entering 
military  service.” 

Part  II  of  the  instrument  gives  two  brief,  general  descriptions  of  hypothetical 
individuals:  Fred  Thompson,  a  17-year-old.  white,  middle-class  high  school  student  living 
in  suburbia;  and  Ppte  Kerber,  a  black,  unmarried,  19-year-old,  inner-city  man  who  has 
graduated  from  high  school  and  is  now  working  as  a  drug  store  clerk  in  the  suburbs.  The 

'A.  Mehrabian.  "Mai*  and  Female  Seale*  of  the  Tendency  to  Achieve,"  in  Educational  and 
Prychologicat  Meaeurement.  vol.  28.  1968,  pp.  493-502. 

1  Mehrabian,  1969,  op.  eif. 

3  McClelland,  D  C.  The  Achieving  Society,  Van  Noalrand,  Princeton,  N.J.,  1961. 

4R.N.  McMurry.  "The  Mydique  of  Super-Saleamanahip,"  in  Harvard  Butinem  Review,  vol.  39, 
no.  2,  March- April,  1061. 
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recruiter's  task  is  to  answer  identical  seta  of  multiple-choice  questions  concerning  these 
two  young  men.  A  sample  item  ia: 

“Which  of  the  following  incentives  would  probably  be  most 

effective  in  inducing _ to  enlist  in  a  combat  branch?” 

a.  a  large  cash  bonus 

b.  a  paid  college  education 

c.  military  pay  comparable  to  civilian  pay 

d.  guaranteed  assignment  in  a  certain  military  specialty 

The  test  is  scored  in  terms  of  the  number  of  items  marked  correctly.  Possible  scores  can 
range  from  0  to  57. 

Knowledge  of  Prospects  Test  No  2.  After  Test  No.  1  was  assembled,  a  more  recent 
poll  of  a  similar  nature  came  to  the  authors'  attention:  “A  Survey  of  Attitudes  and 
Motivations  Towards  Enlistment  in  the  Volunteer  Army”  (Opinion  Research  Corporation, 
1974).  Hence,  Knowledge  of  Prospects  Test  No.  2  was  created,  based  on  the  more  recent, 
and  presumably  mote  valid  poll. 

The  more  recent  survey  collected  the  opinions  of  (a)  American  males,  aged 
T4-2T,  (b)  the  parents  of  young  men  aged  17-21;  and  (c)  educators  from  various  high 
schools.  From  the  published  results,  questions  were  formulated  regarding  the  non-college 
males,  aged  17-21,  who  constitute  the  prime  enlistment  prospects.  The  following  is  a 
sample  of  the  30  True- False  items  created: 

“He  considers  time  spent  in  the  Armed  Forces  as  time 

ill-spent,  as  time  wasted.” 

Personnel  Questionnaire.  The  title  “Personnel  Questionnaire”  is  simply  an  arbitrary 
label  for  a  collection  of  background-type  items,  11  of  which  might  measure  empathy. 
Sample  content  areas  were:  number  of  siblings,  and  how  often  friends  seek  the  subject’s 
advice.  Scoring  was  empirical,  by  individual  item. 

Hogan  Psychological  Inventory.  This  test  was  actually  the  Hogan  Empathy  Scale.'  It 
consists  of  64  True- False  items,  of  which  the  following  are  examples: 

T  F  1  would  certainly  enjoy  beating  a  crook  at  his  own 
game. 

T  F  I  frequently  undertake  more  than  1  can  accomplish. 

T  F  1  prefer  a  shower  to  a  bath. 


Rejection  Tolerance  Measure 

A  recruiter  who  prospects  actively  will  inevitably  receive  rejections,  rebuffs,  and 
occasional  insults.  If  he  typically  reacts  to  such  experiences  with  distress  and 
discouragement,  both  his  prospecting  effectiveness  and  his  production  will  probably 
deteriorate.  It  seems  likely  that  highly  successful  recruiters  would  have  a  higher  tolerance 
for  rejection  than  the  less  successful.  The  Social  Interactions  Test  was  designed  to 
measure  this  characteristic. 

The  Social  Interactions  Test.  Based  on  a  factor  description  developed  by 
Mehrabian1  a  53-item  True- False  test  to  measure  rejection  tolerance  was  created. 
Mehrabian's  studies  of  affiliative  tendency  and  sensitivity  to  rejection  supply  the  notion 
that  persons  characterized  as  being  high  on  these  two  scales  exhibit  less  flexible 


’  Used  with  the  permission  of  Dr.  R.  Ho(sn.  For  a  detailed  description,  se«  R.  Hogan.  “Dssslopment 
of  an  Empathy  8cale,”  in  Journal  of  Conmtlling  and  Clinical  Ptychology,  vol.  33,  no.  3,  1969,  pp.  307-316. 
1  Mehrabian,  1970,  op.  eit. 
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interpersonal  behavior*.  They  uv  much  mom  likely  to  conform  and  are  lew  willing  to 
associate  with  people  whoae  attitude#  ami  opinion*  differ  from  their  own.  Sample  item* 
from  the  teat  an*: 

T  K  I  try  to  avoid  talking  to  people  who  »eem  cool  *nd 
aland -offi«h. 

T  K  When  I  know  a  person  w  the  type  that  make*  cntkal 
comment*.  I  avoid  talking  to  him. 

The  (coring  system  developed  for  the  teat  wa«  con»i*tent  with  Mehrahian's  factor 
dewnpUon.  Scores  could  theoretically  range  from  0  to  53. 

Responsibility  Maturity  Measure* 

/  Since  a  recruiter  spend*  the  hulk  of  hi*  duty  time  working  without  *upenri*ion,  and 

since  he  represent*  the  Army  to  the  general  public ,  it  t»  essential  that  he  manage  hi* 
personal,  financial,  and  official  duties  with  discretion.  Responsibility  is  s  characteristic  to 
which  recruiter  selection  lH»ml*  p*y  (vsrticulsr  attention.  The  three  instruments  described 
in  this  section  were  used  to  inessure  this  characteristic. 

Background  Information  Komi  (Items  22,  231. 

Personnel  tjuestionnnire  (Items  14191. 

Various  items  m  these  two  instruments  attempt  to  measure  responsibility  or 
maturity  Sample  items  deal  with  the  purpose*  for  which  the  subject  ha*  borrowed 
money,  and  the  numlier  of  automobile  accident*  in  which  he  ha*  I  wen  involved.  Storing 
waa  empirical. 

The  I  K  Scale.  Hotter ‘s  I  K  Scale  (Internal  Kxtemall1  >.*  a  questionnaire  designs'll  to 
a**es*  the  degree  (o  which  a  person  think*  rewind  (reinforcement)  i*  eontmgent  on  hi* 
own  behavior  (internal  control)  or  independent  of  it  (external  control).  I're*umahlv 
individuals  with  a  strong  sense  of  res(*onsthihty  would  score  high  on  the  Internal 
Control  dimension. 

The  questionnaire  consists  of  29  items,  each  of  which  provide*  alternative 
statements  about  the  wavs  people  react  to  events  in  society  and  in  their  personal  lives. 
The  subject  select.*  the  statement  in  esch  pair  that  he  believes  more  strongly  to  !*e  the 
case,  lie  is  specifically  instructed  to  select  the  statement  he  actually  believes  to  be 
true,  rather  than  the  one  he  think*  he  should  choose  or  would  like  to  he  true.  A\ 
sample  item  is: 

a.  Many  of  the  unhappy  things  in  |»eoplc‘s  lives  are  partly 
due  to  had  luck. 

b.  People's  misfortunes  re*ult  from  the  mistake*  they 
make. 

Scoring  was  in  accordance  with  Hotter'*  key.  Six  of  the  25*  item*  sre  filler* 
(i.e  .are  not  scored).  Score*  can  range  from  0  23  Strictly  s|'e*king.  won'*  represent 
the  strength  of  the  subject's  belief  lit  external  control;  low  wore*  thus  imply 
the  opposite. 


SELECTION  OF  RESEARCH  SU8JECTS 

Since  the  criterion  development  effort  was  not  completed  m  time  to  use  the  new 
criterion  wore*  as  a  hams  for  evaluating  the  potential  selection  tests,  the  decision  was 

1  Reproduced  by  permission  of  t*  Julian  Rolls?  See  J  H.  Rotter  "Denetallaed  ICspectaneta#  for 
Internal  Veraua  Kslernal  t'onlrol  of  Iteinfois'emenl, "  in  f5rvcSolo*io»if  Vont*gru|>ka,  is'  Sill*,  ml  SO,  no  l. 
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made  to  evaluate  the  tost*  by  administering  them  to  two  group*  of  remitters, 
representing  the  extreme*  of  talent.  The  plan  called  for  selecting  50  of  the  best 
recruiters  in  the  country  amt  50  of  tire  poorest,  amt  determining  whether  the  lent 
instruments  would  dim  nnunate  lietween  them. 

Tv*  ensure  adequate  gevigTaphioal  representation,  two  PRC*  were  selected  from 
each  of  the  five  Hilt's  (formerly  tallest  District*).  Those  selected  were  the  highest  and 
the  lowest  ranking  PH(»  within  each  KRC.  based  on  the  percentage  of  objective* 

achieved  from  July  to  I  Vi-ember.  lOT.'l. 

The  following  procedure  was  u.wxl  to  identify  for  testing  the  five  highest  and  the 
five  i>*o rent  recruiter*  within  each  PRC.  Kach  of  five  supervisory  personnel  waa  asked 
to  nominste  in  writing  the  Idhcsf  and  the  JO  poorest  recruiter*  within  hia  DRC.  (The 
nomination  form  i*  reproduced  in  Appendix  C.)  For  each  name  that  appeared  in  either 
list,  a  tally  wa*  made  of  the  total  number  of  lime*  he  was  mentioned.  The  five  men 
mentioned  mod  often  on  the  "N'st  recruiter"  list  were  selected  a*  the  subject*  in  our 
High  tYitenon  C.roup  Vhe  five  mentioned  most  often  on  the  "poor  recnliteT,,  list  were 
ilesigtiateii  a*  i>ur  l  ow  lYiterion  Croup 

Although  (hi*  plan  involves  the  use  of  *ut*ervt*or  ratings,  which  we  have 

characterised  as  generally  unreliable,  it  nevertheless  apt«ears  to  t*e  sound.  Using  the 

composite  lodgment  of  five  .«it|*orv»*or*.  msteait  of  one.  should  pn’vide  more  reliable 
ratings.  It  seem*  safe  to  assume  that  the  (wo  extreme*  of  recruiter  talent  can  be 

identified  In  this  way  Also,  the  comparison  of  two  such  extreme  group*  should 
maximise  (lie  cham-ea  of  identifying  the  characteristic*  that  relate  significantly  to 
recruiter  effectiveness 

However,  a  few  problems  atom-  in  carrying  out  the  plan.  At  two  PR  Cs,  the  "poor 
recruiter"  lists  wen-  not  filled  out  completely.  When  queried,  the  supervisors  stated 
that  even  their  jvotvsl  man  wa*  consistently  exceeding  bis  objective  which  makes  it 
clear  (hat  a  |*oor  man  in  one  PRC  might  well  surpass  a  good  man  in  another  PRC. 
Since  time  did  not  permit  additional  efforts  to  complete  the  lists,  subjects  were 
selected  from  (lie  lists  available 

Also,  when  the  time  came  for  scheduling  the  testing  sessions,  nianv  of  the 
designated  subjects  weir  not  available  for  one  reason  or  another,  such  as  leave,  illness, 
or  transfer  In  such  cases,  alternates  were  selected  from  (he  original  lists  of  nominees. 

The  number  of  Highs  ami  tows  actually  testi-d  was  -45  and  40  respectively. 


ADMINISTRATION  OF  THl  VIST  BATTERY 

The  test  battery  was  administered  from  V?"  April  to  2 1  May  I  0 7 4  by  Mark  D. 
Wood.  Appmxuuatetv  one  month  before  testing  t>eg*o .  esetr partv  q*a(  nig  P  1\ ( '  received 
*-  communication  fh-m  USAKFC  describing  the  general  purpose  of  the  pniject  and  the 
support  reunited  Subsequent  tv.  the  test  administrator  telephoned  his  PRO  contact  to 
make  detailed  arrangements  ivgarvlmg  date,  time,  physical  facilities,  and  subjects,  later, 
at  the  PRO,  he  briefed  (lie  commander  (or  his  represent  at  net  on  the  nature  of  the 
projects  and  airnnged  to  obtain  production  records  and  ottier  information  on  the  test 
subject* 

'Hie  physical  facilities  for  testing  were  generally  satisfactory  a  quiet  room  With 
convenient  writing  surfai-es  and  another  qniei  place  for  recording  the  verbal 
performance  test  There  were  seme  protilems,  however.  For  example,  id  the  10  PROs 
visited,  three  could  not  tiring  all  10  recruiters  together  for  a  single  administration,  so 
the  test  t*attery  hast  ft*  tie  administer**!  at  two  different  location*  In  one  of  these 
slier  a  busy  recruiting  station  testing  was  subject  to  frequent  interruptions  and 
distractions  At  another  PKt\  where  the  commander  stipulatesi  staggered  test  (*eriods 
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to  avoid  taking  too  many  men  off  production  at  once,  a  group  tecting  situation  was 
not  achieved.  The  effect  on  test  performance  cannot  be  ascertained. 

As  part  of  their  introduction  to  the  testing,  the  subjects  were  informed  that 
USAREC  was  interested  in  developing  an  improved  selection /screening  procedure  for 
identifying  potential  recruiters,  in  order  to  avoid  the  waste  of  time  and  effort  involved 
in  training  men  who  would  not  succeed  in  the  job.  They  were  also  told  how  long  the 
test  would  take  (4-6  hours  was  the  initially  stated  time,  but  it  seldom  took  more  than 
4H  hours,  including  a  break  for  lunch). 

The  men  were  not  told  precisely  how  they  had  been  selected.  Whenever  the 
question  arose,  it  was  explained  that  their  names  had  been  supplied  by  DRC 
administrative  personnel.  In  general  terms,  the  men  were  told  that  we  were  trying  out 
the  tests— seeking  to  find  out  whether  people  with  different  production  levels  would 
answer  the  vest  questions  differently.  Without  exception,  the  cooperation  of  the  test 
subjects  was  excellent 


DATA  ANALYSIS 

Data  analysis  was  directed  at  discovering  significant  differences  between  the  High 
and  the  Low  criterion  groups.  Most  of  the  testa  with  existing  scoring  keys  were 
hand-scored;  each  subject’s  scone  was  recorded  on  a  “Record  Sheet,”  along  with  certain 
data  obtained  from  Army  personnel  records,  such  as,  race,  religion,  GT  and  CL  scores. 
Record  sheet  data  were  then  recorded  on  punch  cards,  along  with  individual  item 
responses  to  the  other  tests. 

Analyses  were  relatively  straightforward.  For  all  test  scores,  and  for  all  item 
responses  that  were  continuous  variables,  means  and  f-testa  were  computed.  For  all 
other  items,  frequencies  and  percentages  of  the  High  and  Low  criterion  group*  who 
marked  each  response  option  were  computed.  Whenever  the  percentages  of  the  two 
groups  appeared  to  differ  substantially,  a  two-by-two  chi-square  statistic  was  computed 
to  evaluate  the  statistical  significance  of  the  difference. 
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Chapter  4 

EVALUATION  OF  TEST  BATTERY 


RESULTS  AND  DISCUSSION 

None  of  the  personality  measures,  and  none  of  the  scores  extracted  from  Army 
personnel  records,  discriminated  significantly  between  the  High  and  Low  criterion  groups. 
The  actual  mean  scores  are  presented  in  Table  4. 


Table  4 

Mean  Scores  of  High  and  Low  Criterion  Groups  on 
Various  Personality  Measures  and  Aptitude  Test  Scores 


Rationality  Maaauraa  and 

Aptitude  Taat  Scoria 

HitfM 

IN  *  46) 

Lome 

IN- 43) 

Significance  of 

■nr- - 9 

'.migfincr 

Sociability  Maaauraa 

Rational  Preference  Taat  No.  1 

31.7 

28.1 

NS 

Peraooal  Prafaranca  Taat  No.  2 

5.9 

5.4 

NS 

Mehrabian'a  Affiliativa  Tandancy 

42.4 

42.0 

NS 

Achievement  Motivation  Maaauraa 

Mahrabian'a  Achieving  Tandancy 

28.8 

31.8 _ 

_ NS 

Empathy  Maaairaa 

-  - . . 

Knowledge  of  Proa  pacta  Taat  No.  1 

27.9 

28.8 

NS 

Knowledge  of  Proa  pacta  Taat  No.  2 

18.0 

18.5 

NS 

Hogan  Empathy  Scale 

34.8 

34.4 

NS 

Rejection  Tolerance  Meaaura 

Social  Interaction  Taat 

28.7 

28.8 

NS 

Raaponaibility-Maturity  - 

-  - 

l-E  Scale 

8.4 

7.1 

NS 

Aptitude  Test  Scoraa 

GT  (General  Technical) 

108.4 

105.5 

NS 

CL  (Clerical) 

108.4 

110.9 

NS 

•There  mar*  no  ttatlatlceily  aignlf  leant  dlffarancaa.  man  whan  applying  a  vary  lanlant  criterion  of 
al*ilflcancefe<.10). 
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The  test  instruments  not  listed  in  Table  4  were  those  for  which  no  scoring  key 
existed.  These  were  the  tests  comprised  of  items  that  were  thought  likely  to  discriminate 
between  Highs  and  Lows,  but  were  to  be  scored  empirically.  As  expected,  the  vast 
majority  of  these  items  did  not  discriminate  between  the  High-rated  and  Low- 
rated  recruiters. 
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A  total  of  22  items  appeared  to  discriminate  significantly  (pC.10).1  Thaw  items, 
which  are  described  below  in  general  terms,  are  not  reproduced  in  this  report.  The  intent 
is  to  minimize  the  chances  that  future  recruiter  applicants  might  somehow  obtain  the 
“correct”  answers  for  the  selection  test  in  advance,  thereby  subverting  the  purpose  of  the 
test.  The  exact  questions  and  a  scoring  key  will,  of  course,  be  made  available  to  USAREC 
officials  and  other  responsible  professionals. 

Regarding  the  22  discriminating  items,  it  should  be  kept  in  mind  that  whenever  a 
large  number  of  significance  tests  are  made,  some  ostensibly  significant  differences  may 
actually  be  chance  differences.  Before  accepting  an  item  as  useful  in  the  selection  process, 
it  is  necessary  to  do  two  things:  (a)  examine  the  item’s  content  to  decide  whether  the 
difference  makes  sense  (if  it  does  not.  the  difference  is  especially  likely  to  be  a  chance 
result),  and  (b)  subject  the  item  to  cross-validation  to  make  sure  that  it  comistently 
discriminates  in  the  same  way. 

Four  of  our  22  items  are  suspect  on  the  grounds  of  implausibility,  although  it  is  > 

nevertheless  possible  that  they  have  true  validity.  Cross-validation  will  provide  a  final  . 

answer.  Another  item  (mean  number  of  handicaps  marked  as  making  his  job  difficult)  is  1  1 

almost  certainly  a  genuinely  discriminating  item;  however,  it  would  be  of  no  use  in  ; 

selecting  future  recruiters  since  the  question  itself  does  not  apply  to  people  without  , 

recruiting  experience. 

The  remaining  items  have  at  least  some  plausibility.  They  pertain  to  such  charac¬ 
teristics  as  work  habits,  style  of  handling  finances  and  debts,  educational  background,  and 
reactions  to  challenging  or  stressful  situations.  J 

The  question,  of  course,  arises  as  to  whether  this  set  of  apparently  discriminating  r 

items  might  be  useful  in  actual  recruiter  selection.  A  very  short  test,  made  up  of  these  22 
items,  would  be  ideal— if  it  worked.  But  at  this  time  we  cannot  be  sure  that  it  would; 
cross-validation  would  be  essential.  By  this  we  mean  that  the  set  of  items  must  be 
administered  to  a  new  set  of  recruiters  (or  perhaps  recruiter  applicants)  and  a  determina¬ 
tion  made  of  how  well  the  items  discriminate  between  the  various  levels  of 

recruiter  talent.  *  . 

Let  us  consider  a  simple  paper-and-pencil  test  since  such  a  test  is  very  economical  to 
administer,  score,  and  interpret.  This  would  eliminate  the  discriminating  item  that  results 
from  the  verbal  performance  test.  The  item  concerned  with  the  number  of  reemiting 
handicaps  would  also  be  eliminated  since,  as  explained  earlier,  it  is  irrelevant  for  selection 
purposes.  This  would  leave  20  items,  with  possible  scores  ranging  from  zero  to  20. 

Since  time  and  funding  limitations  did  not  permit  the  conduct  of  a  cross-validation 
phase,  we  will  sketch  the  following  two  relatively  simple  and  economical  plans  for  filling 
the  gap. 

Plan  A.  Revised  test  booklets  can  be  produced  and  arrangements  made  with 
USAREC  to  administer  them  to  all  recruiter  applicants  who  pass  the  present  recruiter 
selection  boards.  Probably  no  more  than  10  minutes  per  subject  would  be  required. 

Completed  test  booklets  can  be  transmitted  to  HumRRO  for  scoring  and  retention.  After 

about  200  of  the  men  tested  have  been  on  the  job  for  six  months,  SAS  (Simple 

Achievement  Scores)  can  he  computed  for  each.  (These  are  the  scores  described  in 

Chapter  2,  which  express  each  subject’s  production  over  six  months  as  a  percentage  of  , 

the  average  per  recruiter  in  his  DRC.)  Correlations  can  be  computed  between  selection 

test  scores  and  SAS  scores.  The  resulting  data  can  be  analyzed  to  evaluate  the  expected 

value  to  USAREC  of  using  the  test  routinely  to  select  recruiters. 


BEST  AVAILABLE  COPY 


*r**r* 


*rrn**+> 


This  plan  is  an  example  of  the  follow-up  method  of  selection  test  validation.  It 
has  many  advantages,  including  cost  economy,  but  it  does  require  a  rather  lengthy  period 
of  calendar  time,  roughly  one  year. 

Plan  B.  Arrangements  can  be  made  with  USAREC  to  distribute  copies  of  the  revised 
test  booklet  to  a  large  sample  consisting  of  perhaps  200  randomly  selected  recruiters 
across  the  country.  Tests  can  be  administered  by  an  officer  in  each  DRC,  who  will  be 
asked  to  mail  the  completed  booklets  back  to  HumRRO  along  with:  (a)  the  six-month 
production  score  for  each  subject,  and  (b)  the  average  production  per  recruiter  in  the 
DRC.  HumRRO  researchers  will  then  compute  selection  test  scores  and  SAS  scores,  and 
perform  the  same  analyses  described  for  Plan  A. 

Plan  B  has  the  distinct  advantage  of  requiring  little  time— perhaps  two  months. 
A  theoretical  disadvantage  is  that  selection  test  scores  might  correlate  with  experience.  In 
other  words,  some  of  the  things  measured  in  the  test  might  change  as  a  result  of 
recruiting  experience.  If  this  were  the  case,  the  concurrent  validation  approach  in  Plan  B 
would  give  an  erroneous  view  of  how  the  test  would  work  with  true  recruiter  applicants, 
who  have  no  recruiting  experience.  The  possibility  of  such  an  error  can,  of  course,  be 
checked  by  obtaining  information  about  the  amount  of  each  subject’s  recruiting 
experience  and  examining  the  correlation  between  that  experience  and  selection 
test  scores. 


WHY  WERE  SO  FEW  DISCRIMINATING  ITEMS  FOUND? 

Although  this  question  cannot  be  answered  definitively,  it  may  be  useful  to  examine 
several  possible  explanatory  factors.  For  example,  the  question  may  be  raised  as  to  the 
adequacy  of  our  two  criterion  groups— whether  they,  in  fact,  represented  two  extremes  of 
talent.  It  will  be  recalled  that  subjects  were  selected  initially  through  a  supervisory  rating 
system  based  not  only  on  production  records  but  also  on  how  the  subjects  operated 

overall.  Twelve  of  the  subjects  in  the  High  Criterion  Group  had  made  less  than  100%  of _ 

their  objective  over  the  six-month  period  while  13  in  the  Low-rated  group  had  exceeded 
their  objective.  To  check  the  adequacy  of  our  <r..terion  groups,  all  subjects  were  reclassi¬ 
fied  solely  on  the  basis  of  whether  they  had  met  their  objectives.  In  these  groups,  no 
significant  differences  in  test  performance  were  found.  It  thus  appears  that  our  basic 
procedure  for  forming  High  and  Low  groups  is  superior  to  the  method  based  solely  on 
the  percentage  of  objectives  achieved. 

Another  possible  explanatory  factor  is  that  recruiters  may  already  be  a  highly  select 
group.  All  must  meet  certain  minimum  standards,  such  as  GT  score,  rank,  and  time  in 
service.  Also,  they  probably  possess  similar  attributes  and,  possibly,  similar  attitudes.  The 
mean  number  of  years  on  active  duty  for  all  men  in  our  sample  was  14,  and  men  with 
this  amount  of  service  are  likely  to  have  similar  philosophies.  Hence,  it  is  not  surprising 
that  few  discriminating  items  were  found  in  such  areas  as  social  interaction  attitudes, 
internal-external  orientation,  personal  opinions  and  preferences,  and  personality  traits. 

The  few  items  that  did  discriminate  were  mostly  from  the  Background  Information  Form 
and  Personnel  Questionnaire— instruments  dealing  mainly  with  matters  of  fact  rather 
than  attitude, 

In  short,  our  criterion  study  results  indicate  that  territorial  characteristics  account 
for  at  least  50%  of  the  variance  in  production  scores.  This  suggests  that  individual 
recruiter  characteristics  may  be  relatively  unimportant,  at  least  within  rather  broad  limits. 
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Appendix  A 


USAREC  LETTER  DIRECTING  RRC’S  TO  PROVIDE 
DATA  FOR  CRITERION  STUDY 


DEPARTMENT  OF  THE  ARMY 

HEAOQUARTERS  UNITED  STATES  ARMY  RECRUITING  COMMANO 
FORT  SHERIDAN.  ILLINOIS  60037 


USARCDPA-CS 


SUBJECT:  Survey  Information  for  HumRRO 


Commander,  US  Army  First  Recruiting  District 
Commander,  US  Army  Third  Recruiting  District 
Commander,  US  Army  Fourth  Recruiting  District 
Commander,  US  Army  Fifth  Recruiting  District 
Commander,  US  Army  Sixth  Recruiting  District 


1.  The  US  Army  Research  Institute,  Human  Resources  Research  Organization  (HumRRO), 
is  currently  conducting  a  research  project  for  this  Command. 

2.  To  supply  HumRRO  with  information  they  require  to  complete  their  research  project, 
the  data  requested  on  attached  Inclosure  1  must  be  furnished. 

3.  Each  district  will  select  at  random  100  field  recruiters  and  complete  the  information 
requested  on  attached  inclosure.  To  select  the  100  recruiters,  the  last  digit  of  the  social 
security  number  will  be  utilized.  First,  select  recruiters  whose  last  digit  ends  in  one.  If  100 
cannot  be  selected,  then  select  recruiters  whose  last  digit  ends  in  two.  Continue  this 
method  until  100  recruiters  have  been  selected. 

4.  Individuals  selected  meet  the  following  criteria: 

a.  On  production  in  present  assignment  for  the  period  of  July  to  December  1973. 

b.  Have  had  individual  objectives  assigned  for  the  same  period. 

5.  The  consolidated  package  containing  the  100  survey  information  sheets  will  be 
returned  to  this  headquarters,  ATTN:  USARCDPA-CS,  NLT  28  Feb  74. 

FOR  THE  COMMANDER: 


1  Incl  W.H.  SACHS,  JR. 

as  COLONEL,  GS 

Director  of  Personnel  &  Administration 
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SURVEY  INFORMATION  SHEET 


1.  NAME: 


(LAST) 


(FIRST) 


(MIDDLE) 


2.  SSAN 


RCID: 


3.  Name  A  Addle*  of  Area  Commander: 


4.  Name  A  Address  of  RMS: 


5.  Name  of  officer  in  individual’s  RMS  who  may  be  contacted  by  HumRRO  if 
assistance  is  required: 


6.  JUL  AUG  SEP  OCT  NOV  DEC 

NPS-PS  OBJ 

NPS-PS  ACC 
%  ACC 

7.  JUL  AUG  SEP  OCT  NOV  DEC 

POINT  SCORE: 


8.  Total  number  of  months  on  production 


best  available  copy 


USAREC  Form  344(OT),  19  February  1974. 
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Appendix  B 

LIST  OF  DISTRICT  RECRUITING  COMMANDS  PROVIDING 
LIST  OF  d,5,*£ata  fqr  CRiTER,0N  STUDY 


Northeastern  Region*!  Recruiting  Command 

Albany  10 

Baltimore  0 

Qnatnn  7 


Albany 

Baltimore 

Boston 

Concord 

Harrisburg 

Newark 

Newburg 

New  Haven 

Ft.  Wadsworth 

Niagara  Falls 

Philadelphia 

providence 

Syracuse 

Washington 

Pittsburgh 


Midwestern  Regional  Recruiting  Command 
Detroit 

Des  Moines  9 


Detroit 

Des  Moines 

Indianapolis 

Milwaukee 

Cincinnati 

Columbus 

Cleveland 

Sioux  Falla 

Twin  Cities 

Fargo 

Omaha 

St.  Louis 

Lansing 

Chicago 

Peoria 


Southeastern  Region*!  lUcmiting  Command  Betfonel  Co»n*nd 


Atlanta 

Beckley 

Charlotte 

Columbia 

Jacksonville 

Louisville 

Miami 

Montgomery 
Nashville 
Raleigh 
Richmond 
San  Juan 


Boise 

Helena 

Honolulu 

Los  Angeles 

Phoenix 

Portland 

Sacramento 

Fort  Douglas 

Alameda 

Santa  Ana 

Bellevue 


Southwestern  Regional  Recruiting  Command 
Albuquerque  7 

Amarillo  9 

Dallas  9 

Denver  0 

Houston  9 

Jackson  9 

Kansas  City  15 

Little  Rock  1° 

New  Orleans  3 

Oklahoma  City  10 

San  Antonio  JL 


<8L£C0Py 


S3 


Reproduced  From 
Best  Available  Copy 


Appendix  C 

FORM  USED  IN  SELECTING  SUBJECTS  FOR 
RECRUITER  SELECTION  RESEARCH 


Your  Name  Job  Title  RMS  * 


DATA  COLLECTION  FORM 

(For  Recruiter  Selection  Research) 

The  Human  Resources  Research  Organization  (HumRRO)  is  conducting  a  research 
project  for  I’SARKC.  The  objective  of  the  research  is  to  develop  a  procedure  for  identify¬ 
ing  men  who  are  most  likely  to  be  both  successful  and  happy  in  recruiting  work.  To  assist 
in  this  project  you  are  being  asked  to  name  the  10  recruiters  whom  you  consider  to  be  the 
very  best  in  your  RMS.  and  also  name  the  10  whom  you  believe  to  be  the  very  poorest  in 
your  RMS. 


Note  Carefully: 

(1)  Consider  only  men  who  have  been  on  production  for  the  past  six  months. 

(2)  Do  not  base  your  judgement  solely  on  production  records  or  percent  of 
objective  achieved.  You  should  also  take  into  account,  as  best  you  know 
how,  the  quality  of  the  man’s  territory’,  any  lucky  breaks  or  bad  breaks  he 
may  have  had.  and  anything  else  that  you  think  is  important.  In  other  words, 
try  to  be  as  fair  as  you  jiossibly  can. 

(3)  Make  your  selections  all  by  yourself;  do  not  discuss  them  with  anyone  until 
after  you  have  submitted  your  completed  lists  to  your  RMS  Commander. 

(4)  If  you  are  unable  to  make  10  selections  that  you  are  confident  of,  just  name 
as  many  as  you  can  and  stop. 


TEN  BEST 

(Starting  with  the  very  best) 


TEN  POOREST 
(Starting  with  the  very  poorest) 


1.  _ _ 

(Last  Name,  Rank,  First  Name,  Initial) 

2.  _ 

3.  -- _ 

4-  ____________ _ _ 

5.  _ __ 

6.  _ _ 

7.  _ _ 

8.  _ _ _ _ 

9 _ 

10.  _ _ 


1. _ 

(Last  Name,  Rank,  First  Name,  Initial) 

2.  _ _ _ 

3.  _  ■ _ 

4.  _ _______________ 

5.  _ _ 

6.  _ _ _ 

7 _ _ 

8.  _  _ 

9 _ _ 

10.  _ _ 


u 


best  available  copy 


